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PC/TV system User interface, for example, should allow a User to 
view aNselected program and permit User operation of functions 
such as \ Email, telephone, Internet access, .fax and video-phone 
functionsA Such applications require communication between a 
5 PC/TV unity and a variety of both remote sources e.g. a satellite 
service provider, and local sources e.g. a DVD storage device. 
Further, a POHTV needs to process and decode data in different 
data formats frVn different devices and display received data to 
the User. These Voblems are addressed by a system according to 
1 0 the present invention. 

Shmmary of the Invention 

The inventorsN. have hereby recognized that a Program 
1 5 Guide type of User interface advantageously provides a simple, 
easy to use interface for Us^ operation of functions such as Email, 
telephone, Internet access, mx, home control, and video-phone 
functions. The use of a Program Guide for such functions also 
advantageously provides a singleXuser interface for User operation 
2 0 of multiple devices and associated^ functions. 

The inventors have further recognized that Internet 
information requested via a progrank guide or other type of User 
interface may be advantageously conveyed in a composite data 
format including MPEG compatible vi^eo data. They have further 

2 5 recognized that it is desirable for a v\deo decoder system to be 

capable of decoding such a composite dAa format. 

A disclosed data format incudes MPEG compatible 
video data and Internet image information suitable for conveying 
packetized video program data and associated web image 

3 0 information. The data format comprises MPEG system data that 

includes a first transport packet with a header containing a first 

data 'identifier (PID) for identifying the vicfeo program data in a 
payload of the first transport packet. The MPEG system data also 

includes a second transport packet containing a second data 

3 5 identifier (PID) for identifying Internet infoiination contained in a 

payload of the second transport packet. THe MPEG system data 

also includes ancillary, data supporting t^e identification and 
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30 
CLAIMS 

1. A composite data format including MPEG compatible 
video dat^and Internet image information suitable for conveying 
5 packetizedXvideo program data and associated web image 
information, Vomprising: 

MPEG sy^em data including 

(a) aVirst transport packet with a header containing a 
first data identifiervTPlD) for identifying said video program data 

1 0 in a payload of saidVirst transport packet; 

(b) a second transport packet containing 

a second data identifier (PID) for identifying said 
Internet information, saidMnternet information being contained in 
a payload of said second transport packet; and 

ancillary d^l^ containing said second data 
identifier and supporting iderft^fication and decoding of said 
Internet information. 

2. A data format accordingSto claim 1, wherein 

2 0 said ancillary data includes at least one of: (a) a web 

image data start code; (b) a packet courft; (c) packet length; (d) 
packet linking data; (e) a web image data\indication flag; (f) a 
timing parameter for synchronizing web imagXinformation with a 
video or audio program; (g) web image si^ and (h) error 

2 5 correction data. 

3. A data format according to claim 2, wherel 
at least one element of said ancillary data is c^itained 

in said header of said second transport packet; and 
^0 at least one element of said ancillary data is contaiked 

in said payload of said second transport packet. 

4. A data format according to claim 1, wherein 
said second data identifier is contained in a header of 

3 5 said second transport packet. 
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5. A data format according to claim 1, wherein 

said ancillary data is contained in said payload of said 
second transport packet. 

5 

6. A data format according to claim 1, wherein 

said MPEG system data includes program map 
information for associating said Internet information and said 
video program. 

10 

7. A data format according to claim 6, wherein 

said program map information associates said Internet 
information, said first data identifier and said second data 
identifier. 

15 

8. A data format according to claim 1, wherein 

said video program data is MPEG compatible 
compressed video data and said Internet information is non-MPEG 
compatible data. 

20 

9. A data format according to claim 8, wherein 

said Internet information comprises non-compressed 

video data. 

2 5 10. A method for decoding a datastream containing 

packetized video program data and associated web image 
information, comprising the steps of: 

identifying said video program data in a payload of a 
first transport packet using a first data identifier (PID) contained 

3 0 in a header of said first transport packet; 

deriving a second data identifier (PID) from ancillary 
data supporting identification and decoding of Internet 
information in a second transport packet; 

identifying said Internet information in a payload of 
3 5 said second transport packet using said second data identifier; and 

assembling said Internet information into an output 
datastream using said ancillary data. 
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11. A method according to claim 10, wherein in said 
assembling step 

said Internet information is assembled into said output 
5 datastream using at least one of: (a) a web image data start code; 
(b) a packet count; (c) packet length; (d) packet linking data; (e) a 
web image data indication flag; (f) a timing parameter for 
synchronizing web image information with a video or audio 
program; and (g) error correction data. 

10 

12. A method according to claim 10, including the 

steps of 

decoding said assembled Internet information using a 
first method to provide a first decoded output; 
1 5 decoding said video program data using a second 

method to provide a second decoded output. 

13. A method according to claim 12, wherein 

said first method decodes non-MPEG compatible 
2 0 Internet information, and 

said second method decompresses MPEG compatible 
compressed video data. 

14. A method according to claim 10, wherein in said 

2 5 deriving step 

said second data identifier is derived from program 
map information associating said second data identifier with said 
Internet information. 

3 0 15. A method according to claim 10, including the step 

of 

deriving said first data identifier from program map 
information associating said first data identifier with said video 
program data. 

35 
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16. A method for decoding a datastream containing 
packetized video program data and associated web image 
information, comprising the steps of: 

identifying said video program data in a payload of a 
5 first transport packet using a first data identifier (PID) contained 
in a header of said first transport packet; 

deriving a second data identifier (PID) from ancillary 
data supporting identification and decoding of Internet 
information in a second transport packet; 
10 identifying said Internet information in a payload of 

said second transport packet using said second data identifier; and 
synchronizing said Internet information with said 
video program using said ancillary data. 

15 17. A method according to claim 16, further including 

the steps of 

identifying audio program data, and 
synchronizing said audio data with said Internet 
information, 

20 
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I. Basis of the report 

1 This report has been drawn on the basis of {substitute sheets which have been furnished to the receiving Office in 
' response to an invitation under Article 14 are referred to in this report as "originally filed" and are not annexed to 
the report since they do not contain amendments.): 



Description, pages: 

1 3-29 as originally filed 

2_2a as received on 



30/03/1 999 with letter of 



25/03/1999 



Claims, No.: 

1-22 



as received on 



30/03/1999 with letter of 



25/03/1999 



Drawings, sheets: 

1/9-9/9 as originally filed 

2. The amendments have resulted in the cancellation of: 

□ the description, pages: 

□ the claims, Nos.: 

□ the drawings, sheets: 

3. □ This report has been established as if (some of) the amendments had not been made, since they have been 

considered to go beyond the disclosure as filed (Rule 70.2(c)): 

4. Additional observations, if necessary: 



III. 



Non-establishment of opinion with regard to novetty, inventive step and industrial applicabilHy 



The questions whether the claimed invention appears to be novel, to involve an inventive step (to be non-obvious), 
or to be industrially applicable have not been examined in respect of: 



□ 
IE! 



the entire international application, 
claims Nos. 16-22. 
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□ the said international application, or the said claims Nos. relate to the following subject matter which does 
not require an intemational preliminary examination (spec/^: 



□ the description, claims or drawings {indicate particular elements belov^ or said claims Nos. are so unclear 
that no meaningful opinion could be formed (spec^: 



□ the claims, or said claims Nos. are so inadequately supported by the description that no meaningful opinion 
could be formed. 

K ho international search report has been established for the said claims Nos. 16-22. 



V. Reasoned statement under Article 35(2) with regard to novetty, inventive step or industrial 
applicability; citations and explanations supporting such statement 



1. Statement 



Novelty (N) 


Yes: 


Claims 


1-15 




No: 


Claims 




Inventive step (IS) 


Yes: 


Claims 






No: 


Claims 


1-15 


Industrial applicability (lA) 


Yes: 


Claims 


1-15 




No: 


Claims 





2. Citations and explanations 
see separate sheet 
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VI. Certain documents cited 

1. Certain published documents (Rule 70.10) 
and / or 

2. Non-written disclosures (Rule 70.9) 
see separate sheet 

VII. Certain defects in the international application 

The following defects in the form or contents of the international application have been noted: 
see separate sheet 
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To section III: 

Independent claims 16 and 19 comprise the feature that the Internet information is 
processed to form a composite image with the video program. This feature was not in 
the original set of claims and has not been searched. Consequently, no search report 
has been established for present claims 16-22. 

To section V: 

With regard to claim 1 the document US-A-5 544 161 (hereinafter referred to as D1) 
discloses a data format for distributing video and other information through an ATM 
network. An ATM packet demultiplexer provides for flexible MPEG addressing of incom- 
ing data, i.e. it encodes the data into MPEG packets having specific PIDs (column 7, 
line 66 to column 8 line 21). Hence there already exists a composite MPEG data format 
carrying video data packets, which include respective identifiers in the header, and 
other information packets likewise including corresponding identifiers in the header. 

Present claim 1 includes the following additional features: 
(a) the second transport packet contains Internet information 

(a) the second data packet contains ancillary data for supporting identification and de- 
coding of the Internet information. 

Regarding feature (a) it is already known from D1 to enable transport of Internet data 
through the network (column 8, lines 53-62). Since the ATM packet demultiplexer en- 
codes various kinds of data into MPEG form a skilled person would directly envisage to 
also encode Internet information into MPEG form to transmit it to users through the 
network described in D1. Regarding feature (b) it is an intrinsic feature of MPEG pack- 
ets that the header contains information supporting decoding of the received informa- 
tion. For example, a header of a video sequence defines things like frame rate, resolu- 
tion etc (see D1, column 24, lines 13-16). Hence a skilled person directly envisages to 
include information for supporting decoding also in the additional packets which carry 
Internet information. Therefore, the method of claim 1 is not based on an inventive 
step. 

The additional features of claims 2-5 are likewise evident from D1, see passages above 
and column 10, line 25 to column 11, line 44 as well as column 23, lines 48-51. The 
features of claims 6-9 are obvious from D1, see passages mentioned above and col- 
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umn 23, lines 48-64. 

Claim 10 concerns a method of decoding a data stream having a format as described in 
claim 1. A skilled person which intends to detect different kind of data from the received 
data stream directly envisages that the data identifiers corresponding to packets carry- 
ing desired information are identified. See also D1, column 23, line 48 to column 24, 
line 22. 

Claims 11-15 relate to details of decoding the MPEG and non- MPEG data which are 
obvious from the above mentioned passages of D1. 

To section VI: 

The documents: 

WO-A-97 28499 (filed 31 .1 .97; published 7.8.97; claimed priority 2.2.96), 
WO-A-97 41690 (filed 1.5.97; published 6.1 1.97; claimed priority 2.5.96), and 
US-A-5 666 487 (filed 28.6.95; published 9.9.97) 

are considered as relevant with the present claims. It should be mentioned that their 
priorities and that of the present application have not been checked. 

To section VII: 

Reference signs in parentheses should be inserted in the claims to increase their intelli- 
gibility. Rule 6.2(b) PCI. This applies to both the preamble and characterising portion. 
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